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What GAO Found 


Certain groups of students are overrepresented at alternative schools—public 
schools with a disciplinary or academic focus that serve students who have 

been expelled or suspended from school, or are at risk of educational failure 
—compared to their enrollment at nonalternative schools. Overall enrollment 
and discipline of students at these schools dropped between school years 
2013-14 and 2015-16, according to GAO's analysis of Department of Education 
(Education) data. Declines in White and Hispanic student enrollment accounted 
for most of the drop. Some groups, such as Black boys and boys with disabilities, 
were overrepresented in alternative schools, particularly those with a discipline 
focus, compared to their enrollment at nonalternative schools (see figure). While 
overall discipline dropped for students at alternative schools, school arrests and 
referrals to law enforcement went up by 33 and 15 percent, respectively, for 
Black boys and girls between school years 2013-14 and 2015-16. 


Under/Overrepresentation at Alternative Schools, School Year 2015-16 


We used the terms “underrepresented” and “overrepresented” to describe instances in which a student group 
had a lower or higher level of enrollment at alternative schools compared to their representation in the student 
population at nonalternative schools. Our analyses of these data, taken alone, do not establish whether unlawful 
discrimination has occurred. 
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Alternative schools have some of the most vulnerable students, but lower 
percentages of alternative schools have various types of support staff than 
nonalternative schools. Compared to nonalternative schools in 2015-16, a lower 
percentage of alternative schools had social workers, nurses, and counselors— 
support staff who serve different roles in addressing the health, behavioral, and 
emotional needs of students. For example, 47 percent of nonalternative schools 
had at least one social worker, compared to 26 percent of alternative schools. In 
every district GAO visited, officials said students had experienced multiple types 
of trauma, such as gang violence, death of schoolmates or parents, poverty, 

or homelessness—consistent with research linking trauma with educational 

and behavioral challenges—and described various strategies they used to meet 
student needs despite their staffing challenges. 
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Introduction 


June 13, 2019 
Dear Mr. Chairman: 


Students in public K-12 alternative schools are among some of the 
most vulnerable populations in schools. These schools serve students 
that have been expelled or suspended from school, or are at risk 

of educational failure because of poor grades, truancy, disruptive 
behavior, mental health issues, being a teen parent, and other life 
circumstances. Further, enrollment at alternative schools can be 
fluid, with some students attending anywhere from a few days to a 
few years, while others cycle in and out of these schools repeatedly. 
Alternative schools can be of various types—regular public schools, 
charter schools, and juvenile justice facilities (i.e., facilities where 
students are incarcerated). Alternative schools are public and can be 
operated by a school district or a private company under contract 
with a school district. They can also have different focuses, such 

as academic, disciplinary, or both. Alternative schools can vary 
significantly from school to school in how they operate and how 
information on students who attend these schools is reported by 
individual school districts—data that are required to be reported for 
federal oversight. 


You asked us to report on the student population in alternative 
schools. This report examines what is known about (1) enrollment, 
discipline, and support staff, such as counselors and psychologists, in 
alternative schools; and (2) the ways selected school districts report 
data on alternative schools for federal oversight. 


To determine what is known about enrollment, discipline, and 

support staff in alternative schools, we analyzed the Department of 
Education's (Education) Civil Rights Data Collection (CRDC) for the 

two most recent collections, 2013-14 and 2015-16 school years.' 

CRDC collects a range of information on public schools nationwide, 
including student demographics (e.g., race, sex, disability), school type, 
discipline, and staffing. We used Education's Office for Civil Rights 
(OCR) 2015-16 CRDC definition of an alternative school: “[A] public 


TCRDC is a biennial national survey that Education requires nearly all public school 
districts and schools to complete; specifically, territorial schools (except for Puerto 
Rico, commencing for the 2017-18 CRDC collection), Department of Defense schools, 
and tribal schools are not part of the CRDC. 
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elementary or secondary school that addresses the needs of students 
that typically cannot be met in a regular school program. The school 
provides nontraditional education; serves as an adjunct to a regular 
school; and falls outside of the categories of regular education, 
special education, or vocational education."* Further, because juvenile 
justice facilities also address the educational needs of students that 
cannot be met in a regular school setting, we included in our study 

all juvenile justice facilities that are reported in the CRDC, whether 

or not they were identified as alternative schools. 3 For many of our 
analyses, we compared students at alternative schools with students 
at nonalternative schools.* Results of our analyses are associational 
and do not imply a causal relationship. We determined these data 
were sufficiently reliable for the purposes of this report by reviewing 
documentation, conducting electronic testing, and interviewing 
Education officials. 


To gather information on what is known about the ways selected 
school districts report data on alternative schools for federal 
oversight, we visited seven school districts in three states, Florida, 
Illinois, and Texas. These states were selected to represent a mix of 
states with high numbers and proportions of alternative schools, the 
presence of alternative schools run under contract to private entities, 
and geographic diversity. We selected school districts and schools 

for a mix of alternative school type (regular alternative, charter 
alternative, juvenile justice facility), focus (academic, disciplinary, 
mixed academic and disciplinary), and location (urban, suburban, 
rural). Within each state, we visited at least two school districts; within 
each district, we visited up to four alternative schools. These site 
visits also served to supplement our CRDC data analysis to provide 
illustrative examples of schools and the students they serve. Although 
the results of these site visits are not generalizable to all states or 


2See CRDC’s 2015-16 School Form: https://www2.ed.gov/about/offices/list/ocr/docs/ 
crdc-2015-16-all-schools-form.pdf. 

3according to Education officials, schools are identified in the CRDC as a juvenile 
justice facility based on the Common Core of Data (CCD) directory information. For 
school year 2013-14 data, OCR was also able to cross-reference these data with 
the Department of Justice's Office of Juvenile Justice and Delinquency Prevention 
(OJJDP). The CRDC does not permit a school district to classify a school as a juvenile 
justice facility or not. They are already designated as such. However, according to 
Education officials, school districts may notify OCR of a discrepancy in the type of 
school designation so that OCR can engage in a process to correct the information. 
4We defined nonalternative schools as any school in the CRDC, including special 
education schools, that didn't fall under our definition of alternative schools. 
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school districts, they provide illustrative examples of how different 
states and school districts report data on alternative schools to 
Education as part of its CRDC. See appendix | for more information on 
our objectives, scope, and methodology. 


We conducted this performance audit from April 2018 to June 2019 in 
accordance with generally accepted government auditing standards. 
Those standards require that we plan and perform the audit to obtain 
sufficient, appropriate evidence to provide a reasonable basis for 

our findings and conclusions based on our audit objectives. We 
believe that the evidence obtained provides a reasonable basis for our 
findings and conclusions based on our audit objectives. 
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Background 


Overview of 
Alternative Schools 


According to data from Education’s CRDC, fewer than 1 percent of 

all public school students attended alternative schools in school 

year 2015-16 (roughly 369,000 students). Yet these students are 
among the most vulnerable because they are often on the verge 

of dropping out, are incarcerated, or were expelled or suspended 
from their nonalternative schools. Some alternative schools have an 
academic focus and help students earn credits toward graduation if 
they are behind in school or if they need to graduate early in order 

to attend to other necessities, such as working or parenting. Other 
alternative schools—referred to by some districts as their discipline 
schools—have a disciplinary focus and serve students who have been 
suspended or expelled from their nonalternative school. Alternative 
schools may be operated by school districts themselves or by private 
for-profit or non-profit entities that contract with the public school 
districts. These entities are subject to specific contractual obligations. 
These contractual obligations could include requirements related to 
services the contractor must provide, performance and accountability 
standards, and record keeping requirements for purposes of reporting 
student-level data to the contracting school district. There are various 
types of alternative schools, including regular public schools (77 
percent), charter schools (6 percent), and juvenile justice facilities (17 
percent).° 


"The CRDC defines a justice facility as a public or private facility that confines pre- 
adjudicated/pre-convicted individuals, post-adjudicated/post-convicted individuals, or 
both. A justice facility includes short-term and long-term facilities, such as correctional 
facilities, detention centers, jails, and prisons. Only individuals up to 21 years of 

age who are confined in justice facilities are reported for the CRDC. According to 

OCR, justice facilities that are operated by entities other than school districts or 

public schools would not be included in the CRDC, unless the school district’s own 
elementary or secondary educational program was conducted through the justice 
facility. Juvenile justice facilities are often the responsibility of state or local juvenile 
justice agencies, and the educational services may be provided by the agency 
operating the facility, a state educational agency, a local educational agency (LEA) 
serving that geographical community, a different public provider, or a private provider 
(through a contract with a public agency). For purposes of this report, we refer to 
regular public schools that are alternative schools as “regular alternative schools,” and 
charter schools that are alternative schools as “charter alternative schools.” 
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Research on 
Discipline in 
Schools 


In our 2018 report on discipline in K-12 schools, we found that 

Black students, boys, and students with disabilities experienced 
disproportionate levels of discipline in school year 2013-14 across 

all types of schools, including alternative schools.® As we reported in 
2018, who gets disciplined and why is complex. Studies we reviewed 
for that report suggest that implicit bias—stereotypes or unconscious 
associations about people—on the part of teachers and staff may 
cause them to judge students’ behaviors differently based on the 
students’ race and sex.’ The studies showed that these judgments can 
result in certain groups of students being more harshly disciplined 
than others. Further, the studies found that the types of offenses 
that Black children were disciplined for were largely based on school 
officials’ interpretations of behavior. For example, one study found 
that Black girls were disproportionately disciplined for subjective 
interpretations of what constitutes disobedience and disruptive 
behavior. 


Further, a child's performance and behavior in school may be affected 
by health and social challenges outside the classroom that tend 

to be more acute for poor children, including minority children 

who experience higher rates of poverty, and for those who have 
experienced trauma.® Research shows that experiencing trauma in 


®GAO, K-12 Education: Discipline Disparities for Black Students, Boys, and Students 
with Disabilities, GAO-18-258 (Washington, D.C.: Mar. 22, 2018). 

7Edward Morris and Brea Perry, Girls Behaving Badly? Race, Gender, and Subjective 
Evaluation in the Discipline of African American Girls (2017). This study was conducted 
in a large, urban public school district in Kentucky for students in grades six through 
12 between August 2007 and June 2011. See also Keith Smolkowski et al., Vulnerable 
Decision Points for Disproportionate Office Discipline Referrals: Comparisons of 
Discipline for African American and White Elementary School Students (2016). 

This study was conducted using data from the 2011-12 school year, and limited to 
elementary schools that used a standardized system for tracking discipline referrals. 
8 iliana Fernandes, Americo Mendes, and Aurora Teixeira, A Review Essay on the 
Measurement of Child Well-Being, The American Academy of Pediatrics (2011); 

The Lifelong Effects of Early Childhood Adversity and Toxic Stress, The American 
Academy of Pediatrics (2012); Mediators and Adverse Effects of Child Poverty in 

the United States, The American Academy of Pediatrics (2016); U.S. Department of 
Commerce, U.S. Census Bureau, Current Population Survey, 2008 to 2017 Annual 
Social Economic Supplements, as cited by GAO, Child Well-Being: Key Considerations 
for Policymakers Including the Need for a Federal Cross-Agency Priority Goal, 
GAO-18-41SP (Washington, D.C.: Nov. 2017). 
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childhood may lead to educational challenges, such as lower grades 
and more suspensions and expulsions; increased use of mental 
health services; and increased involvement with the child welfare 

and juvenile justice systems, according to the U.S. Department of 
Health and Human Services’ Substance Abuse and Mental Health 
Services Administration (SAMHSA).? Some research has found that 
youth in juvenile justice facilities report experiencing multiple types 
and instances of trauma, such as assault, family and community 
violence, and physical or sexual abuse.'° For example, in one study of 
youth involved in the juvenile justice system in New Hampshire and 
Ohio, 94 percent reported having experienced at least one trauma 

in their lifetime, and the average number of traumas reported was 
about five.'’ Other research indicates that creating a positive school 
climate, including social and emotional learning programming, may 
lead to more positive academic and behavioral outcomes in schools. '2 
Creating a positive school environment can include employing 
resources to help students develop the social, emotional, and conflict 
resolution skills needed to avoid and de-escalate problems, and 
targeting supports to help address underlying causes of misbehavior, 
such as trauma. School psychologists, social workers, nurses, and 
counselors can all play a role in supporting the health, behavioral, and 
emotional needs of students. 


9SAMHSA and The National Child Traumatic Stress Network, Understanding Child 
Trauma, SMA-15-4923 (2016). 

10R. Charak, J.D. Ford, C.A. Modrowski, and P.K. Kerig, "Polyvictimization, Emotion 
Dysregulation, Symptoms of Posttraumatic Stress Disorder, and Behavioral Health 
Problems among Justice-Involved Youth: a Latent Class Analysis," Journal of Abnormal 
Child Psychology (April 2018). See also AJ. Sedlak, and K. McPherson, Survey of Youth 
in Residential Placement: Youth's Needs and Services, SYRP Report (Rockville, MD: 
Westat (2010)). 

The study was of a nonprobability sample of 350 youth. See H.J. Rosenberg, J.E. 
Vance, S.D. Rosenberg, G.L. Wolford, S.\W. Ashley, and M.L. Howard, "Trauma Exposure, 
Psychiatric Disorders, and Resiliency in Juvenile-Justice-Involved Youth," Psychological 
Trauma: Theory, Research, Practice, and Policy, vol. 6, no. 4 (2014), pp. 430-437. 

125¢e A. Thapa, J. Cohen, A. Higgins-D‘Alessandro, and S. Guffey, School Climate 
Research Summary: August 2012, School Climate Brief, No.3 (New York, NY: National 
School Climate Center, 2012): www.schoolclimate.org/climate/research.php; and J.A. 
Durlak, R.P. Weissberg, A.B. Dymnicki, R.D. Taylor, and K.B. Schellinger, "The impact of 
enhancing students’ social and emotional learning: A meta-analysis of school-based 
universal interventions," Child Development, 82(1) (2011): pp. 405-432. 
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Education and 
Justice Enforcement 
Responsibilities 


Education's OCR and the Department of Justice’s (Justice) Civil 

Rights Division and its Office for Civil Rights for the Office of Justice 
Programs are responsible for enforcing a number of civil rights laws, 
which protect students from discrimination on the basis of certain 
characteristics.!? As part of their enforcement responsibilities, both 
agencies conduct investigations in response to complaints or reports 
of possible discrimination.'4 Education may also seek to terminate 
federal funds if a recipient is determined to be in violation of the 

civil rights laws and the agency is unable to reach agreement with 
the parties involved.'° Further, Justice has the authority to file suit in 
federal court to enforce the civil rights of students in public education. 


Additionally, Justice's Office of Juvenile Justice and Delinquency 
Prevention (OJJDP) supports local and state efforts to prevent 
delinquency and improve the juvenile justice system. OJJDP sponsors 
research, program, and training initiatives; develops priorities 

and goals and sets policies to guide federal juvenile justice issues; 
disseminates information about juvenile justice issues; and awards 
funds to states to support local programming. OJJDP supports 
prevention and intervention programs aimed at helping young 
people overcome the challenges in their lives and avoid involvement 
with the justice system. For example, in fiscal year 2015, OJJDP 
provided more than $77 million in discretionary funding to strengthen 


13Both agencies also have regulations requiring that they conduct periodic reviews 

of recipients of federal funding for compliance with certain laws they enforce. See, 

for example, 34 C.F.R. 8 100.7 and 28 C.F.R. 8 42.107, requiring Education and Justice, 
respectively, to periodically review the practices of recipients of federal funding to 
determine whether they are complying with Title VI requirements. The procedural 
provisions of Title VI also apply to Title IX of the Education Amendments Act of 1972 
and Section 504 of the Rehabilitation Act of 1973. In addition, according to Justice, 
Justice's Civil Rights Division can remedy a “pattern or practice” of conduct that 
violates the constitutional or federal statutory rights of youth in schools in juvenile 
justice facilities. See 42 U.S.C. 88 1997-1997}; 34 U.S.C. 8 12601. 

14Education also carries out agency-initiated investigations, which they call 
compliance reviews and directed investigations, that assess the practices of recipients 
to determine whether they comply with the laws and regulations OCR enforces. 
TSagency officials told us that this rarely happens. Before termination of federal funds 
can occur, a recipient, among other things, has the right to request a hearing. GAO, 
K-12 Education: Better Use of Information Could Help Agencies Identify Disparities 
and Address Racial Discrimination, GAO-16-345 (Washington, D.C.: Apr. 21, 2016). 
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K-12 Student 
Enrollment 


mentoring programs across the nation. These programs were focused 
on addressing the mentoring needs of underserved populations, 
including tribal youth, youth with disabilities, youth in foster care, and 
child victims of commercial sexual exploitation. 


Education's OCR also administers the CRDC, a biennial national survey 
that Education requires nearly all public school districts and schools 
to complete, and publishes the data and reports on its website.'® The 
CRDC survey collects a variety of information on student enrollment, 
discipline, and staff (such as teachers, psychologists, and counselors), 
most of which is disaggregated by race/ethnicity, sex, limited English 
proficiency, and disability. Data for the CRDC are self-reported by 
school districts, and are based on two different points in the school 
year. The fall snapshot captures enrollment, student demographics, 
and school type data as of October 1 or the closest school day to 
October 1; and the cumulative end of the year count captures data 
such as school staff and all incidents of discipline for the entire school 
year. School districts report discipline under six broad categories 

in Education’s CRDC: (1) out-of-school suspensions, (2) in-school 
suspensions, (3) referrals to law enforcement, (4) expulsions, (5) 
corporal punishment, and (6) school-related arrests. 


Of the more than 50 million students in public K-12 schools in school 
year 2015-16, about one-half were White and the other half fell into 
one of several minority groups, with Hispanic and Black students 
being the largest minority groups, according to CRDC data (see table 
1). The number of boys and girls in public schools was almost evenly 
split. A larger percentage of boys were students with disabilities. 


Te https://www2.ed.gov/about/offices/list/ocr/data.html. 
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Table 1: Student Enrollment in K-12 Public Schools, by Race, Sex, and pisabiity Status, School Year 2015-16 
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Girls with disabilities 2107 


Source: GAO analysis of data from the Department of Education's Civil Rights Data Collection for school year 2015-16. | GAO-19-373 


In our 2016 report, we found that schools with a relatively large 
proportion of students in poverty also tend to have a higher 
proportion of minority students.'” As we have reported, over time, 
there has been a large increase in schools that are the most isolated 
by poverty and race, and the link between racial and ethnic minorities 
and poverty is longstanding, and also affects access to a quality 
education. We also reported in 2018 that students in relatively poor 
—where 80 percent of students are Black and Hispanic—and small 
schools had less access to high school courses that help prepare them 


for college. '8 


17G AO, K-12 Education: Better Use of Information Could Help Agencies Identify 
Disparities and Address Racial Discrimination, GAO-16-345 (Washington, D.C.: Apr. 21, 
2016). 

18G a0, K-12 Education: Public High Schools with More Students in Poverty and 
Smaller Schools Provide Fewer Academic Offerings to Prepare for College, GAO-19-8 
(Washington, D.C.: Oct. 11, 2018). 
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Major Findings 


Enrollment and Discipline Varied by Race, Sex, and Disability 
Status in Alternative Schools, a Lower Percentage of which Have 
Support Staff Compared to Nonalternative Schools 


Certain Groups Are 
Overrepresented 
in Alternative 
Schools Compared 
to Nonalternative 
Schools 


Enrollment 


Enrollment at alternative schools declined by about 114,000 students, 
or about 25 percent, between school years 2013-14 and 2015-16, 
according to our analysis of Education’s most recent two school years 
of CRDC data (see fig. 1).'9 Steep drops in White and Hispanic student 
enrollment accounted for about 75 percent of this change (42 and 

34 percent, respectively); that is, White boys (25 percent) and girls 

(17 percent) accounted for 42 percent of the drop, and Hispanic boys 
(19 percent) and girls (15 percent) accounted for 34 percent. The 
decline in enrollment was less steep for Black boys and girls, at 17 
percent (11 and 6 percent, respectively). Enrollment for other student 
groups—boys and girls who are Asian American, American Indian/ 
Alaska Native, and Multi-race—remained relatively constant, with each 
group accounting for no more than 2 percent of the decline over the 
same time period. These other student groups also made up a much 
smaller percentage of the overall enrollment at alternative schools. 
For boys and girls with disabilities, enrollment dropped 12 percent (9 
and 3 percent, respectively).7° 


19in contrast, enrollment in all K-12 schools increased by around 1 percent during this 
time. 

2The percent decline in enrollment of boys and girls with disabilities is calculated 
separately from that of other demographic groups. 
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Figure 1: Enrollment Declines between School Years 2013-14 and 2015-16 and Over/Underrepresentation in School Year 
2015-16 at Alternative Schools Compared to Nonalternative Schools by Demographic Group 


Decline in enrollment 
(Difference between 2013-14 and 2015-16) 


Over/underrepresentation by group® (2015-16) 


Underrepresented < » Overrepresented 
28,260 


(25%) White boys 6 


19,113 
(17%) 


White girls 10 


21,382 : ‘ 
(19%) Hispanic boys 
17,148 F ini 
Percentage of ——» (15%) Hispanie gins 
overall decline 
in enrollment 12,107 
(11%) Black boys 
6,475 : 
(6%) Black girls 
2,278 F 
(2%) Asian boys 2 
1,892 : : 
(2%) Asian girls 2 
1,757 
(2%) AI/AN boys 0 
1,538 F 
(1%) AI/AN girls 0 
1,254 Multi-race 0 
(1%) boys 
1,130 Multi-race 0 
(1%) girls 
10,415 Boys with 2 
(9%) disabilities 
3,318 Girls with 0 
(3%) disabilities 
30,000 25,000 20,000 15,000 10,000 5,000 0 10 8 6 4 2 0 2 4 6 8 
Number of students 


Percentage point difference 


Source: GAO analysis of data from Department of Education’s Civil Rights Data Collection for school years 2013-14 and 2015-16. | GAO-19-373 AI/AN = American Indian/Alaska Native 


“We used the term “overrepresented” to describe instances in which a student group 
had a higher level of enrollment at alternative schools compared to their representation 
in the overall student population at nonalternative schools. We used the term 
“underrepresented” to describe instances in which a student group had a lower level of 
enrollment at alternative schools compared to their representation in the overall student 
population at nonalternative schools. 

Note: The percent decline in enrollment of boys and girls with disabilities is calculated 
separately from that of other demographic groups. Our analyses of these data, taken 
alone, do not establish whether unlawful discrimination has occurred. 


Black and Hispanic boys and girls, and boys with disabilities, were 
overrepresented at alternative schools in 2015-16, and White and 
Asian boys and girls were underrepresented, according to our analysis 
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of Education's CRDC data (see fig. 1).2’ The data also showed this for 
school year 2013-14. Further, these overrepresented groups also 
made up a larger proportion of enrollment at alternative schools 
than they did at nonalternative schools, according to our analysis 

of Education's school year 2015-16 data (see fig. 2). For example, 
Black boys accounted for 8 percent of students at nonalternative 
schools and 16 percent of students at alternative schools. This was 
also true for Hispanic boys, who accounted for 13 percent of students 
at nonalternative schools and 20 percent of students at alternative 
schools. White and Asian boys and girls attended nonalternative 


schools in greater proportions than they did alternative schools. 


Figure 2: Student Enrollment in Alternative and Nonalternative Schools, by Demographic Group, School Year 2015-16 
Percentage of students 


25 
25 24 Girls i Boys 


20 
20 19 


16 


15 14 14 
13 13 


11 


10 


White Hispanic Black Asian AI/AN Multi- Students White Hispanic Black Asian AIAN Multi- Students 
race with race with 
| Alternative schools disabilities disabilities 
cae Nonalternative schools AI/AN = American Indian/Alaska Native 


Source: GAO analysis of data from the Department of Education’s Civil Rights Data Collection for school year 2015-16. | GAO-19-373 


Note: The percent enrollment of boys and girls with disabilities is calculated separately 
from that of other demographic groups. Our analyses of these data, taken alone, do not 
establish whether unlawful discrimination has occurred. 


Our analysis of these data showed similar patterns of 
overrepresentation for Black boys and girls, Hispanic boys, and boys 
with disabilities at alternative schools when compared to these 


21 Our analyses of these data, taken alone, do not establish whether unlawful 
discrimination has occurred. 


22This was also the case for Multi-race girls, but not for Multi-race boys. 
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groups' representation at nonalternative schools, regardless of the 
type—regular alternative, charter alternative, and juvenile justice 
facility (see table 2). In juvenile justice facilities, Black boys were 
overrepresented by 28 percent, followed by boys with disabilities 
and Hispanic boys. In addition, when we analyzed these data by 

the focus of alternative schools—disciplinary, academic, or mixture 
of both—Black boys, in particular, but also boys with disabilities 

and Hispanic boys, were the most overrepresented in disciplinary 
schools. Specifically, Black boys were overrepresented by 22 percent, 
Hispanic boys by 8 percent, and boys with disabilities by 10 percent, as 
compared to these groups' representation in nonalternative schools. 
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Table 2: Over/Underrepresentation in Enrollment at Alternative Schools Compared to Nonalternative Schools by 
Demographic Group by School Type and Focus, School Year 2015-16 


[7 J Alternative school type Alternative school focus 


Regular Charter Juvenile 
alternative alternative justice Disciplinary Academic 
schools (%) schools (%) facilities (%) (%) (%) Mixed (%) 


Powe ff =] =f f=, 
a 
a 
a 8 


American Indian +4 +1 +4 +1 
or Alaska Native 
students 
American Indian +1 +1 +4 
or Alaska Native 
boys 
American Indian 
or Alaska Native 
girls 
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Boys with 
disabilities 


Girls with 
disabilities 


Legend: + = overrepresented - = underrepresented. 
Source: GAO analysis of data from the Department of Education's Civil Rights Data Collection for school year 2015-16. | GAO-19-373 


Note: We used the term “overrepresented” to describe instances in which a student 
group had a higher level of enrollment at alternative schools compared to their 
representation in the overall student population at nonalternative schools. We used the 
term "underrepresented" to describe instances in which a student group had a lower 
level of enrollment at alternative schools compared to their representation in the overall 
student population at nonalternative schools. Our analyses of these data, taken alone, do 
not establish whether unlawful discrimination has occurred. 


Further, nearly 75 percent of students who were transferred to 
alternative schools for disciplinary reasons in school year 2015-16 
were Black or Hispanic (see fig. 3). Among boys, Black and Hispanic 
boys were transferred at higher rates than White and Asian boys. 
Among girls, Black girls (14 percent) were transferred at about twice 
the rates of Hispanic and White girls. 
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Figure 3: Percentage of Students Transferred to Alternative Schools for 
Disciplinary Reasons, School Year 2015-16 

Percentage of students 

35 
30 
25 
20 


15 


10 


White Hispanic Black Asian AIAN Multi- Students 
race with 

[| Girls disabilities 

= Boys AI/AN = American Indian/Alaska Native 


Source: GAO analysis of data from the Department of Education’s Civil Rights Data Collection for school year 2015-16. | GAO-19-373 


Note: The percentage of students transferred for boys and girls with disabilities is 
calculated separately from that of other demographic groups. Students may be transferred 
to alternative schools for a disciplinary infraction, a pattern of problematic behavior, or 
continual academic issues, according to the Department of Education. Our analyses of 
these data, taken alone, do not establish whether unlawful discrimination has occurred. 


We also found geographic patterns with respect to the proportion of 
alternative schools by district (see fig. 4). In addition, according to our 
analysis of Education's school year 2015-16 data, about 28 percent of 
students in nonalternative schools attended schools in urban areas, 
compared to 43 percent of alternative school students (see appendix 
| for more information).?? Education officials suggested that this 

may be because in smaller rural districts, there may not be sufficient 
numbers of students to establish and operate a separate alternative 
school campus. 


23 For this analysis, we used the 2015-16 Common Core of Data (CCD) locale variable. 
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Figure 4: Percentage of Public Schools That Are Alternative by District, School Year 2015-16 
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Discipline 


The number of students disciplined in alternative schools dropped in 
2015-16 compared to 2013-14 across most types of discipline for most 
groups of students. However, for some groups, such as Black boys 
and girls, rates for all of the types of discipline we examined either 
declined more modestly or went up, according to our analysis of 
CRDC data across those two school years (see table 3).*4 For example, 


24Discipline rates also generally went up across all types of discipline for Multi-race 
boys and girls. We did not present or analyze data for certain types of discipline 
reported as having been administered to fewer than 30 students in a given group. 
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from 2013-14 to 2015-16, declines for out-of-school suspensions 
were less steep for Black boys and girls than for White and Hispanic 
boys and girls. In addition, school-related arrests and referrals to law 
enforcement increased for Black boys and girls.?° 


As a result, this statement is based on types of discipline reported as having been 
administered to 30 or more students in a given group. 


25Both school-related arrests and referrals to law enforcement also increased for 
Multi-race boys and girls. 
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Table 3: Change and Percent Change in Number of Alternative School Students Disciplined by Demographic Group and 
Type of Discipline, School Years 2013-14 to 2015-16 
Type of Discipline 


Corporal One or more One or more Any School-_ | Referral to law 
punishment in-school | out-of-school expulsion related enforcement 
suspensions suspensions arrest 


19 -1,303 -10,739 -1,476 -417 

(+7) (-4) (-13) (-24) (-5) 

5 -1,244 -2,817 -402 -384 

(-5) (-12) (-13) (-25) (-16) 
9 


-12 -993 -2,129 -273 -320 

(-12) (-14) (-13) (-24) (-18) 

i -251 -688 -129 -64 

(-9) (-11) (-31) (-10) 

Hispanic -- All -1,464 -5,460 -554 -330 
(-16) (-22) (-29) (-13) 

Hispanic -1,169 -4,307 -448 -293 
BLys (-18) (-23) (-30) (-15) 
-295 -1,153 -106 -37 

(-12) (-17) (-25) (-6) 

Black -- All +26 +1,691 -1,715 -443 +341 
(+19) (+17) (-6) (-19) (+15) 


Hispanic 
Girls 


+2 +1,017 -1,222 -335 +139 
(+27) (+15) (-7) (-20) (+8) 
+674 -493 -108 +202 

(+21) (-6) (-16) (+34) 

-146 -396 -17 

(-40) (-35) (-18) (-15) 

-99 -324 “5 

(-38) (-37) (-22) (-6) 
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Legend: + = percent increase - = percent decrease 
Source: GAO analysis of data from the Department of Education's Civil Rights Data Collection for school years 2013-14 and 2015-16. | GAO-19-373 


Note: Numbers and percentages based on counts of fewer than 30 students are not 
presented in this table and instead are replaced with a “--” due to the small number of 
incidents. Our analyses of these data, taken alone, do not establish whether unlawful 
discrimination has occurred. "Any expulsion" refers to expulsions with and without 
educational services. 
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Lower Percentages 
of Alternative 
Schools Compared 
to Nonalternative 
Schools Reported 
Having Most Types 
of Support Staff 


While the number of students disciplined generally dropped for boys 
and girls with disabilities from school year 2013-14 to 2015-16, they 
were overrepresented in alternative schools across most forms of 
discipline in 2015-16, compared to their enrollment at alternative 
schools.?° 


Compared to nonalternative schools in 2015-16, a lower percentage 
of alternative schools had social workers, nurses, and counselors 
—support staff who serve different roles in addressing the health, 
behavioral, and emotional needs of students (see table 4). 27 


26while both boys and girls with disabilities were overrepresented in discipline in 
2015-16, the overrepresentation was lower for the girls. For example, in 2015-16, 
boys with disabilities were overrepresented by 10 percent in their referrals to law 
enforcement, compared to their enrollment at alternative schools, while girls with 
disabilities were overrepresented by 2 percent for the same form of discipline. 

27 Our analysis was limited to counselors and the support services staff—social 
workers, nurses, and psychologists—for which data are collected by the CRDC. 
Schools were included for a given type of support staff if the number of Full-Time 
Equivalents (FTE) for that type of staff was greater than zero at that school. 
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Table 4: Percentage of Nonalternative and Alternative Schools with Specific 
Types of Support Staff, School Year 2015-16 


Type of school Percentage of |Percentage of |Percentage of Percentage 
schools with schools with |schools with any |of schools 
any social any nurses psychologists with any 
workers counselors 


Source: GAO analysis of data from the Department of Education's Civil Rights Data Collection for school year 2015-16 | 
GAO-19-373 


Note: Schools were included for a given type of support staff if the number of Full-Time 
Equivalents (FTE) for that type of staff was greater than zero at that school. Support staff 
serve different roles in addressing the health, behavioral, and emotional needs of students. 
Note that levels for each type of support staff are calculated separately, and schools may 
have more than one type of support staff. We did not include juvenile justice facilities in 
this analysis because the Civil Rights Data Collection data for justice facilities represent 
only support staff who serve students who are in the educational program offered at the 
facility; therefore, it may not capture all support staff who work at the facility. 


For example, nearly one-half of nonalternative schools had at least 
one social worker, compared to about one-quarter of alternative 
schools, according to our analysis of Education's data for school year 
2015-16.78 


The largest differences between alternative and nonalternative 
schools were in the proportion of schools with nurses and counselors. 
A higher percentage of alternative schools than nonalternative 
schools had psychologists, another type of support staff, in 2015-16. 
(See table 5 for staff definitions.) Education officials suggested that 
school and district size, among other factors, may have an effect on 
staffing levels. 


28 We did not include juvenile justice facilities in this calculation because the CRDC 
data for justice facilities represent only support staff serving students who are in the 
educational program offered at the facility; therefore, the data may not capture all 
support staff who work at the facility. 
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Table 5: Definitions of Support Staff 


Social worker Provides social services and assistance to improve the social and psychological functioning 
of children and their families and to maximize the family well-being and the academic 
functioning of the children. 


Nurse qualified health care professional who addresses the health needs of students. 


Psychologist Evaluates and analyzes students' behavior by measuring and interpreting their intellectual, 
emotional, and social development, and diagnosing their educational and personal 
problems. 


Counselor A professional staff member assigned specific duties and school time for any of the 
following activities: counseling with students and parents, consulting with other staff 
members on learning problems, evaluating student abilities, assisting students in making 
education and career choices, assisting students in personal and social development, 
providing referral assistance, and/or working with other staff members in planning and 
conducting guidance programs for students. 


Source: U.S. Department of Education's Civil Rights Data Collection, 2015-16 | GAO-19-373 


Across different types of alternative schools, charter alternative 
schools had lower rates of support staff compared to regular 
alternative schools, especially for social workers, nurses, and 
counselors. For example, 10 percent of charter alternative schools 
reported having one or more nurses, compared to 30 percent of 
regular alternative schools. 


During our site visits, officials in every school district described the 
multiple types of trauma that students experienced—such as gang 
violence that affected students in and outside of school, the death of 
schoolmates or parents, poverty, or homelessness. District and school 
officials described the challenges they faced in providing the staff 
necessary to support their students, and various strategies they used 
to meet student needs. For example: 


¢ Officials in one district that provides services to a largely Black 
male student population at juvenile justice facilities said most 
students have experienced trauma and many face mental health 
issues, such as mood disorders. These officials also said that 
in this district, almost 95 percent of girls in these facilities have 
been victimized in some way, including sexually. To address 
these issues, the district is providing professional development 
around being trauma-informed. District officials noted that due 
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to budgetary issues, it took around 8 to 10 months to hire the 
required support staff to help address students’ needs. 


¢ In an urban school district whose alternative school population 
is primarily Black and Hispanic, district officials told us that there 
has been an increased need to address trauma experienced by 
students. Staff at a number of the district's alternative schools 
received trauma-informed professional development, and some 
schools located in areas with gang activity have a restorative 
justice practice coach on site twice a week to work with teachers 
and staff.?9 District officials reported that efforts are made to 
ensure students are placed in an environment that is conducive 
to their safety and learning and indicated that attendance is 
impacted by complex situations including physical and mental 
health problems, substance abuse, pre-existing trauma, and lack 
of transportation, among other things. 


e At an alternative high school that predominantly serves White and 
Hispanic students who are at risk academically, officials told us 
that a large proportion of students had experienced the death 
of a parent or had some other trauma during middle school. In 
addition, an estimated 17 percent of students had attempted 
suicide in the past year. We spoke with one student whose 
brother died in a car accident moments after letting her out of 
the car. To help their current support staff meet their students’ 
academic, social, and emotional needs, the school also relies on 
two interns who are studying to become licensed social workers. 


¢ In one school serving English language learners, many of whom 
are refugees, school officials told us that some students have 
post-traumatic stress disorder from the war and violence they 
witnessed in their home countries. Further, some students 
arrived in the country unaccompanied and do not have parents 
in the United States. School officials told us that when the school 
opened around 15 years ago, the school arranged to have its own 
dedicated social worker to support the students emotionally to 
help their learning. 


e At arural school that accepts suspended and expelled students 
and serves a largely low-income White population, school officials 
told us that their students are dealing with many issues in their 


29 Restorative justice practice focuses on repairing harm done to relationships 
and people. The aim is to teach students empathy and problem-solving skills that 
can help prevent inappropriate behavior in the future. 
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lives that can take an emotional toll, such as drugs, foster care, 
physical abuse, and sexual abuse. In addition, their students come 
from families that are experiencing high unemployment. District 
officials told us that they had recently hired a crisis intervention 
specialist for the district because they had seen a “giant jump” 

in the number of students experiencing trauma. District officials 
further noted that the district would like to hire a counselor to 
help support alternative school students, but they do not have 

the resources. District officials also told us that due to budget 
cuts, they lacked resources to help support students as they 
transitioned back to their home school, which can be a challenging 
process. 


e At an academically focused alternative school that serves mainly 
low income Black boys and girls, school officials noted that most 
of the students have social and emotional issues related to foster 
care, homelessness, or trauma. Officials told us that the school 
employs one social worker and one family counselor to help 
address these issues. According to school officials, the school 
needs an additional social worker and family counselor to fully 
address students’ needs. 


Using Flexibility Afforded Them, Selected School Districts Differed 
in How They Reported Data on Alternative Schools to Education 


Often citing a highly transitory student population, selected school 
district and school officials we interviewed said that they used the 
flexibilities Education affords them to determine how to report 
discipline incidents when students attend more than one school over 
the course of a school year. Specifically, for purposes of the CRDC, 
Education asks schools to take a count of students, or a snapshot, 

on or around October 1. At the end of the school year, Education 
also requires a count of all students disciplined, by type of discipline, 
for the entire year. To ensure all required data are reported for each 
student, and to prevent duplicative reporting, Education officials 

said they allow districts to assign those cumulative data to a “home 
school,” which can be a student's alternative school or the school 
that referred the student to the alternative school. Selected school 
districts we visited made different choices in assigning a home school 
for reporting purposes. For example: 
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¢ In one large urban school district, officials said they assign 
discipline data for students to the school where the infractions 
took place. In this district, one privately run discipline-focused 
alternative school that we visited had the capacity to serve up to 
100 students at a time. Officials said students typically stay in this 
school between one and two semesters. They told us discipline 
data reported for this school only reflect incidents that occurred at 
this school. 


¢ Ina large school district with 14 alternative schools, district 
officials said that a student's disciplinary incidents are reported 
wherever the student was enrolled around October 1. We visited 
a disciplinary school where officials said they have a highly mobile 
student body. They said that last year they served 1,156 students 
over the course of the year, although they served only about 200 
students at any one time. They said students commonly stay 
for 30 days, but some stay for the remainder of their time in 
high school. Thus, discipline data reported for this school do not 
capture discipline for students transferring in after the October 
fall snapshot date.?° 


e Asenior official in another large school district we visited said they 
do not generally assign student discipline data to those alternative 
schools that are considered temporary placements; instead, all 
discipline is assigned to the student's permanent school, which 
they consider the home school. For example, at one school for 
suspended students in grades 7 through 12, they may be placed 
for 1 to 10 days as an alternative to suspension. Upon completing 
their stay, students return back to their home schools. This school 
does not capture discipline for these students. 


¢ Inthe same school district, alternative schools that serve students 
more long term, such as those with an academic focus, are not 
considered temporary placements. Discipline data for these 
schools, according to a senior school district official, are reported 
based on where a student was enrolled at the end of the school 
year, even if the infractions occurred at another school where the 
student was previously enrolled. 


e According to school district officials from another district, the 
district's juvenile justice facilities, which can incarcerate students 


30School district officials told us that, beginning with the 2017-18 school year, 
they plan to assign all discipline data for students to the school where the 
infractions took place. 
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for longer periods, are considered the home school for purposes 
of reporting cumulative discipline data for students. Therefore, 
discipline incidents that occurred at these facilities would be 
reflected in the data. 


In addition to differences in how the selected districts reflected 
incidents of discipline, we also found differences in how they reported 
the number of alternative schools. For example, one large urban 
school district we visited hired a private firm to run an academic 
alternative school that had three separate campuses, which were 
reported in the CRDC as one alternative school. According to 

school district officials, the data reported for these campuses were 
aggregated because they shared the same identification number for 
federal reporting purposes." School district officials said they are 
working with their state educational agency to reduce the number of 
schools that share the same identification number. In another school 
district, an academic alternative school we visited had four separate 
campuses, but reported one alternative school in the CRDC. School 
district officials said these campuses will continue to be reported as 
one alternative school in the 2017-18 CRDC because they operate 
and report as one entity. Further, school district officials said another 
alternative school focused on discipline that shared a facility with a 
nonalternative elementary school was not separately reported in the 
CRDC. According to district officials, they plan to separately report 

on this alternative school going forward, beginning with the 2017-18 
CRDC. 


31The National Center for Education Statistics (NCES) is the primary federal entity 
for collecting and analyzing data related to education. Public schools, public school 
districts, and many private schools can be assigned NCES identification numbers. 
Each identification number consists of a set of numbers that identify the state, the 
school district, and the individual school building, respectively. For a public school to 
be reported in the 2015-16 CRDC, Education requires each school to have a unique 
NCES ID. 
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We provided a draft of this report to the Departments of Education 
(Education) and Justice (Justice) for review and comment. Education 
provided written comments that are reproduced in appendix III. 
Education and Justice provided technical comments, which we 
incorporated as appropriate. 


In its written comments, Education detailed what it considered 

to be limitations with the report’s methodology and conclusions. 
Specifically, Education said the effects of the demographic variables 
we used in our analysis#race/ethnicity, sex, and disability#to describe 
the population of students in alternative schools, are most likely 

not as powerful as other variables such as socioeconomic status, 
exposure to trauma and violence, and family and neighborhood 
characteristics. Education stated that looking at any one factor in the 
absence of others would likely lead to erroneous results, and could 
confuse readers about whether race/ethnicity is the cause of the 
disproportionality or is simply correlated with other causal factors. 


We agree that factors correlated with an event do not necessarily 
cause that event. While limitations exist with any methodology, we 
believe the limitations related to causality that Education raised 

are misplaced; we do not imply causation for disproportionality 
observed within the data we analyzed or make inferences about 
disproportionality. Our descriptive analyses of these data are 
consistent with our goal of describing the condition by race/ethnicity, 
sex, and disability status. Our results showing overrepresentation 
of certain groups in enrollment and disproportionate discipline 

are associational and do not imply a causal relationship. While we 
make no conclusions about our findings, the findings themselves 
factually describe the enrollment and disciplinary patterns from 
that data. The approach we took to determining disproportionality 
is acommonly used, credible method in the literature we reviewed. 
Education similarly makes descriptive analyses of these data by 
race/ethnicity, sex and disability publicly available on its website in 
various publications.?* For example, Education found that in school- 
year 2015-16, Black boys and girls made up 15 percent of student 


32S¢e, for example, Department of Education Office for Civil Rights, 2015-16 Civil 
Rights Data Collection: School Climate and Safety (Washington, D.C.: 2018 (revised 
May 2019)). See https://www2.ed.gov/about/offices/list/ocr/docs/school-climate-and- 
safety.pdf. 
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enrollment and 31 percent of students referred to law enforcement or 
arrested.?3 


Education's Civil Rights Data Collection (CRDC) does not collect data 
on the variables that the agency proposed that GAO analyze, such 

as exposure to trauma or violence. Therefore, CRDC data do not 
allow us to examine the factors Education asserts are likely predictive 
of enrollment and discipline patterns found in their data. In the 
background of the report, we provide information from studies 

that met our standards for methodological rigor and that help 
explain disproportionate discipline, such as implicit bias and poverty. 
Nevertheless, to reduce any potential confusion about the descriptive 
approach to reporting data from the CRDC, we have added additional 
clarification about our analyses. 


Education also noted that the definitions of alternative schools and 
alternative learning environments vary widely across states, and 
encouraged us to carefully review and consider this variability, as 

it raises issues with the report's methodology and conclusions. We 
disagree. While there may be definitional differences across states, 
as Education notes, we used the definition that Education instructs 
school districts to use as they complete the CRDC to indicate whether 
or not their school is an alternative school. Further, because juvenile 
justice facilities also address the educational needs of students that 
cannot be met in a regular school setting, we included in our study all 
juvenile justice facilities that are reported in the CRDC, whether or not 
they were specifically identified as alternative schools.*4 Moreover, as 
discussed in the report and shown in Table 2, the CRDC data showed 
similar patterns of overrepresentation at alternative schools for Black 
boys and girls, Hispanic boys, and boys with disabilities, regardless of 
the type of school—regular alternative, charter, and juvenile justice 
facility. 


Finally, Education suggested that part of our analysis is based on 
data reported for seven out of nearly 15,000 school districts. As 
stated in the draft report on which Education commented, our main 
analysis relied on data that nearly all school districts reported in the 
CRDC. Another objective of our study was to determine "the ways 
selected school districts report data on alternative schools for federal 


33Department of Education Office for Civil Rights, 2015-16 Civil Rights Data Collection: 
School Climate and Safety (Washington, D.C.: 2018 (revised May 2019)), p. 3. See 
https://www2.ed.gov/about/offices/list/ocr/docs/school-climate-and-safety. pdf. 


34See@ appendix | for additional information on how we defined alternative schools. 
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oversight.” For this objective, we visited seven school districts to 
provide, among other things, illustrative examples of the ways in 
which districts report data to the CRDC. In the draft report Education 
reviewed, we clearly state that these examples are not generalizable 
to all states and school districts. 


As agreed with your office, unless you publicly announce the contents 
of this report earlier, we plan no further distribution until 30 days 
from the report date. At that time, we will send copies of this report to 
the appropriate congressional committees, the Secretary of Education, 
and the Attorney General. In addition, the report will be available at no 
charge on the GAO website at http://www.gao.gov. 


If you or your staff have any questions about this report, please 
contact me at (617) 788-0580 or nowickij@gao.gov. Contact points 
for our Offices of Congressional Relations and Public Affairs may 
be found on the last page of this report. GAO staff who made key 
contributions to this report are listed in appendix IV. 


Sincerely yours, 


SPepWON “Wawsl 


Jacqueline M. Nowicki, Director 


Education, Workforce, and Income Security Issues 
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Congressional Addressees 


Addressees 


Robert C. “Bobby” Scott 

Chairman 

Committee on Education and Labor 
House of Representatives 
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Appendix I: Objectives, Scope, and Methodology 


Analysis of National 
Data on Alternative 
Schools 


The objectives of this report were to examine what is known about (1) 
enrollment, discipline, and support staff in alternative schools, and (2) 
the ways selected school districts report data on alternative schools 
for federal oversight. To conduct this work we analyzed and compared 
federal civil rights data on public alternative and nonalternative 
schools; visited seven school districts in three states to provide 
illustrative examples of alternative schools and their students, and the 
ways in which school districts report data used for federal oversight; 
interviewed federal agency officials; reviewed agency documentation; 
and reviewed federal laws and regulations. To inform all of our work, 
we interviewed representatives of several nonprofit organizations 
that examine laws and policies related to alternative schools. We 

also met with subject matter experts to discuss issues related to 
alternative education and disparities in enrollment and discipline. The 
following sections contain detailed information about the scope and 
methodology for this report. 


To determine what is known about enrollment, discipline, and support 
staff in alternative schools, we analyzed the U.S. Department of 
Education's (Education) Civil Rights Data Collection (CRDC) for school 
year 2015-16 (the most recent) and in some instances school year 
2013-14 (the previous collection) to discern any changes that may 
have occurred in enrollment and discipline between the two most 
recent periods. We analyzed the public-use data file of the CRDC 
that was publicly available as of September 2018. The CRDC is a 
biennial survey that Education requires nearly every public school 
and district in the United States to complete; specifically, territorial 
schools (except for Puerto Rico, commencing for the 2017-18 CRDC 
collection), Department of Defense schools, and tribal schools are 
not part of the CRDC. Conducted by Education's Office for Civil Rights 
(OCR), the survey collects data on the nation’s public schools (pre-K 
through grade 12), including disciplinary actions, enrollment, school 
and student characteristics, and types of school staff. 


To analyze these data, we used OCR's 2015-16 CRDC definition of 

an alternative school: “[A] public elementary or secondary school 

that addresses the needs of students that typically cannot be met 

in a regular school program. The school provides nontraditional 
education; serves as an adjunct to a regular school; and falls outside 
of the categories of regular education, special education, or vocational 
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education."*° CRDC data are self-reported by districts and certified 
by the Superintendent or his/her authorized designee; consequently, 
there is still potential for misreporting of information. Alternative 
schools can be of various types—regular alternative schools and 
charter alternative schools. Further, because juvenile justice facilities 
also address the educational needs of students that cannot be met 
in a regular school setting, we included in our study all juvenile 
justice facilities that are reported in the CRDC, regardless of whether 
they were identified as alternative schools.*° We eliminated magnet 
schools and special education schools that had classified themselves 
as alternative schools, as they do not meet the definition of an 
alternative school. For many of our analyses, we compared students 
at alternative schools with students at nonalternative schools.” 


For our analysis of alternative school enrollment and discipline, we 
analyzed key student demographics, such as race, sex, and disability 
status. There are various credible methodologies than can be used 

to analyze this type of data, and it is possible that different methods 
may produce different results. We used the composition index 
method—one of the more common methods used to calculate under- 
and overrepresentation—which compares each student group's 
representation at alternative schools to their representation at 


35See CRDC’s 2015-16 School Form: https://www2.ed.gov/about/offices/list/ocr/docs/ 
crdc-2015-16-all-schools-form.pdf. 

36according to Education, schools are identified in the CRDC as a juvenile justice 
facility based on the Common Core of Data (CCD) directory information. To prepare 
respondents for the CRDC, OCR obtains from the National Center for Education 
Statistics, a list of schools and school districts used for the CCD. The list includes 
some juvenile justice facilities that have participated in the CCD in the past. For 

the 2013-14 school year data, Education's Office for Civil Rights augmented the 
CRDC universe with juvenile justice facilities, which may not be under the purview 

of the state educational agency or a school district, based on a list provided by 
Department of Justice's Office of Juvenile Justice and Delinquency Prevention (OJJDP). 
Education officials told us that by cross-referencing the OJJDP provided list, OCR is 
able to add justice facilities which may not have been otherwise included in the CCD 
to ensure coverage of all youth in pre- or post-adjudication facilities that receive 
educational services. The CRDC does not include a question for a school district to 
classify a school as a juvenile justice facility or not. They are already designated as 
such. However, according to Education officials, school districts may notify OCR of a 
discrepancy in the type of school designation so that OCR can engage in a process to 
correct the information. 

37 We defined nonalternative schools as any schools in the CRDCG, including special 
education schools, that didn't fall under our definition of alternative schools. 
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nonalternative schools to determine whether there are disparities. 
For example, using this method, if boys accounted for 50 percent of 
all nonalternative school students, but represented 75 percent of 
students at alternative schools, then boys would be overrepresented 
among alternative school students by 25 percentage points. Other 
researchers may choose to use other analytical techniques. For 
example, one alternate method focuses on the risk of a specific group 
falling into a category such as receiving a certain type of discipline, 
versus the risk of all other students falling into that category. We also 
compared the percentage that various groups represented among 
students transferred to disciplinary schools. Results of our descriptive 
analyses are associational and do not imply a causal relationship 
because, for example, the CRDC does not collect data on factors that 
may cause differences in student composition or school assignment, 
and CRDC data were not gathered by a randomized controlled trial, 
where students would be randomized to attend schools with certain 
characteristics. Our analyses of these data, taken alone, do not 
establish whether unlawful discrimination has occurred. 


The 2013-14 and 2015-16 CRDC collected data on six broad types 

of disciplinary actions: (1) corporal punishment, (2) in-school 
suspensions, (3) out-of-school suspensions, (4) expulsions, (5) referrals 
to law enforcement, and (6) school-related arrests. The CRDC did not 
collect data on less severe forms of discipline, such as detentions, 

or removing privileges to engage in extracurricular activities, such as 
athletic teams or field trips. We used the following CRDC variables for 


the disciplinary actions we examined (see table 6).7° 


38The CRDC also collected data on expulsions under zero-tolerance policies; however, 
these data overlap with data on students expelled with or without educational 
services. Consequently, we do not report specific data on students expelled under 
zero-tolerance policies. 
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Table 6: Disciplinary Actions Used in Analysis of the Civil Rights Data Collection (CRDC) 


GAO category CRDC category and definition 


Corporal punishment Corporal punishment 


Definition: paddling, spanking, or other forms of physical punishment imposed on 
a child. 


In-school suspensions One or more in-school suspensions 


Definition: An instance in which a child is temporarily removed from his or her 
regular classroom(s) for at least half a day for disciplinary purposes, but remains 
under the direct supervision of school personnel. 


Out-of-school suspensions One or more out-of-school suspensions 


Definition: Temporarily removing a child from his or her regular school for at least 
half a day for disciplinary purposes. 


Any expulsion Expulsion with Educational Services, Expulsion without Educational Services 


Definition: Expulsion with educational services refers to an action taken by the 
local educational agency of removing a child from his/her regular school for 
disciplinary purposes, and providing educational services to the child (e.g., school- 
provided at home instruction or tutoring; transfer to an alternative school) for 

the remainder of the school year (or longer) in accordance with local educational 
agency policy. Expulsion with educational services also includes removals resulting 
from violations of the Gun Free Schools Act that are modified to less than 365 
days. 


Expulsion without educational services refers to an action taken by the local 
educational agency of removing a child from his/her regular school for disciplinary 
purposes, and not providing educational services to the child for the remainder 

of the school year or longer in accordance with local educational agency policy. 
Expulsion without services also includes removals resulting from violations of the 
Gun Free Schools Act that are modified to less than 365 days. 


Referrals to law enforcement Referral to a law enforcement agency or official 


Definition: An action by which a student is reported to any law enforcement 
agency or official, including a school police unit, for an incident that occurs 
on school grounds, during school-related events, or while taking school 
transportation, regardless of whether official action is taken. 


School-related arrest School-related arrest 


Definition: an arrest of a student for any activity conducted on school grounds, 
during off-campus school activities (including while taking school transportation), 
or due to a referral by any school official. 


Source: GAO analysis of the Department of Education's Civil Rights Data Collection. | GAO-19-373 


For alternative school enrollment and for each of the six discipline 
categories in our review, we examined discipline counts and 
rates both overall and disaggregated by student demographic 
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characteristics, such as student sex (boy or girl), race or ethnicity (see 
table 7), and disability status (students with and without disabilities).>9 
We also examined race and sex intersectionally, for example, 
disciplinary rates for White boys or Hispanic girls. We examined 
disability status and sex intersectionally, but not disability status and 
race, 


390ur analysis of students with disabilities included only those students served under 
the Individuals with Disabilities Education Act. We excluded students served only 
under Section 504 of the Rehabilitation Act of 1973 from our analysis of discipline for 
students with disabilities because the CRDC does not collect data on these students 
disaggregated by race or ethnicity. 
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Table 7: Race and Ethnicity Variables Used in Analysis of the Civil Rights Data 
Collection (CRDC) 


Se 


Asian 


Native Hawaiian or Other Native Hawaiian or Other Pacific Islander Islander 


American Indian or American Se or Alaska Native 
Alaska Native 
Multi-race Two or more races 


Source: GAO analysis of the Department of Education's Civil Rights Data Collection. | GAO-19-373 


In addition to analyzing data on enrollment and discipline, we also 
analyzed CRDC data on school staff. Specifically, we analyzed data on 
the proportions of alternative schools that had at least one support 
professional—counselors, psychologists, nurses, and social workers, 
and compared that to the proportion of nonalternative schools with 
such staff. For alternative schools, we also analyzed levels of these 
support staff by school type, including regular alternative schools and 
charter alternative schools. We did not analyze these staff at juvenile 
justice facilities because the CRDC data for justice facilities represent 
only support staff who serve students who are in the educational 
program offered at the facility; therefore, these data may not capture 
all support staff who work at the facility. 


We analyzed enrollment, discipline, and staff by type of alternative 


school a student attended—regular alternative school, charter 
alternative school, and juvenile justice facility (see table 8). 
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Table 8: Types of Alternative Schools 


Type of alternative Definition Number in our dataset 
school 


Regular alternative Schools for which “alternative” was 
selected in the CRDC and which 
are not charter alternative schools, 
magnet schools, special education 
schools, or juvenile justice facilities. 


Charter alternative Schools for which both “alternative” 51,078 
and “charter” were selected in the 
CRDC and which are not juvenile 
justice facilities. 


Juvenile justice facility {A public or private facility that 40,270 30,519 
confines pre-adjudicated/pre- 
convicted individuals, post- 
adjudicated/post-convicted 
individuals, or both. For the 
purposes of the CRDC, only 
individuals up to 21 years of age 
who are confined in justice facilities 
are of interest. 


Source: GAO analysis of data from the Department of Education's Civil Rights Data Collection (CRDC) for school years 2013-14 and 2015-16. | GAO-19-373 


We also conducted analyses by alternative school focus—academic, 
disciplinary, and mixture of both academic and disciplinary (see table 
9). 
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Table 9: Alternative Schools by Focus 


Alternative school Definition Number in our dataset 


focus 
An alternative school designed 1,390 1,142 186,843 149,830 
to meet the needs of students 
with academic difficulties. 


Disciplinary An alternative school designed 1,060 878 54,326 45,955 
to meet the needs of students 
with discipline problems. 
i An alternative school designed 2,197 1,537 241,812 172,862 
to meet the needs of students 
with academic difficulties and 
discipline problems. 


Source: GAO analysis of data from the Department of Education's Civil Rights Data Collection for school years 2013-14 and 2015-16. | GAO-19-373 


In addition, to analyze alternative school enrollment by locale, we 
used the 2015-16 Common Core of Data (CCD) locale variable. The 
CCD is administered by Education's National Center for Education 
Statistics, and annually collects nonfiscal data about all public schools 
in the nation. The locale variable in the CCD is primarily based ona 
school's location relative to populous areas. To do this, we matched 
schools in the CRDC for school year 2015-16 to schools in the CCD for 
school year 2015-16, and excluded schools for which there was not a 
match. The locale variable is divided into four main types: city, suburb, 
town, and rural. For the purposes of our analyses, we combined 

the town and rural variables into one town/rural variable because 
they are defined similarly (see table 10). We attempted to use the 
free and reduced-price lunch variable from the CCD as a proxy for 
school poverty. However, because this variable was missing from a 
large number of alternative schools, we were unable to conduct this 
analysis. 
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Table 10: Locale Variables Used from the Common Core of Data (CCD) 


GAO category Locale variable from CCD Category definition 


City, Large Territory inside an urbanized area and inside a principal 
City, Midsize cy 

City, Small 

Suburb, Large Territory outside a principal city and inside an urbanized 


Suburb, Midsize aiee 
Suburb, Small 


Town/Rural Town, Fringe Territory inside an urban cluster 


Town, Distant 
Town, Remote 


Rural, Fringe Census-defined rural territory 
Rural, Distant 
Rural, Remote 


Source: GAO analysis of the Department of Education's Common Core of Data (CCD) for school year 2015-16. | GAO-19-373 


Note: The locale variable is primarily based on a school's location relative to populous 
areas. 


We determined that the data we used from the CRDC and CCD were 
sufficiently reliable for the purposes of this report by reviewing 
technical documentation, conducting electronic testing, and 
interviewing officials from Education's OCR and National Center for 
Education Statistics. Past releases of the CRDC have subsequently 
been updated by Education to correct errors and omissions in the 
data. 


School District Site To provide illustrative examples of what is known about the ways 

Visits selected school districts report data on alternative schools for federal 
oversight and to supplement the data we analyzed on enrollment, 
discipline, and support staff in alternative schools, we visited school 
districts and alternative schools in three states—Florida, Illinois, and 
Texas. To select these states, we considered a mix of states with high 
levels and proportions of public alternative schools based on CRDC 
data, geographic dispersion, and the number of alternative schools 
under contract by what we believe to be some of the largest private 
entities based on publicly available data for each state. The CRDC 
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does not indicate whether an alternative school is run by a private 
entity. We reviewed publicly available data to determine if the school 
district contracted with a private entity. 


To identify the alternative schools we visited, we considered CRDC 
data variables regarding the type (regular alternative, charter 
alternative, juvenile justice facility) and number of students enrolled 

in each alternative school, as well as the focus each school serves 
(academic, disciplinary, or a mixture of both) to identify schools of 
varying types and focuses. We also considered whether or not the 
alternative school was publicly or privately run on behalf of a school 
district, including charter schools. Within each state, we visited at least 
two school districts and up to four alternative schools in each district. 


Although the results of these site visits are not generalizable to all 
states or school districts, they provide illustrative examples of the 
ways different states and school districts report data on alternative 
schools to Education. 


We conducted this performance audit from April 2018 to June 2019 in 
accordance with generally accepted government auditing standards. 
Those standards require that we plan and perform the audit to obtain 
sufficient, appropriate evidence to provide a reasonable basis for 

our findings and conclusions based on our audit objectives. We 
believe that the evidence obtained provides a reasonable basis for our 
findings and conclusions based on our audit objectives. 
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Appendix II: Additional Data Tables 


This appendix contains tables that show data based on analyses we 
conducted using the Department of Education's Civil Rights Data 
Collection (CRDC) for school years 2013-14 and 2015-16. The following 
tables are included in this appendix: 


¢ Table 11: Enrollment at Alternative Schools and Percent Change in 
Enrollment by State, School Years 2013-14 to 2015-16 


¢ Table 12: Top 100 Districts Based on Alternative School 
Enrollment, School Year 2015-16 
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Table 11: Enrollment at Alternative Schools and Percent Change in Enrollment by State, School Years 2013-14 to 2015-16 


Enrollment, school Enrollment, school year Percent change Total enrollment 
year 2013-14 2015-16 for alternative and 
nonalternative schools, 

school year 2015-16 


Ce 
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591 647 111,077 
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Source: GAO analysis of data from the Department of Education's Civil Rights Data Collection for school years 2013-14 and 2015-16 | GAO-19-373 
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Table 12: Top 100 Districts Based on Alternative School Enrollment, School Year 2015-16 


Alternative Percentage of alternative school enrollment (%) Total 
school enrollment 


Pnrollment AI/ Students (alternative 

AN i and 

Hisabilitiaonalternative 

schools) 

City of Chicago SD IL 8,978 29 2 1 19 392,303 
299 

ee 


Falcon School co 4,279 4 49 42 1 1 3 3 20,588 
District No. 49 in 


ot={e[-[e[e|°[ =| = 
A 


Joint School District 3,208 37,659 
No. 2 


Jefferson County | Jefferson County | | 3,048 | 048 } 107,018 | ,018 


School District No. 3,036 90,482 
1 in the County of 

Denver and State 

of Colorado 


Pinelas | | 2,985. | 985 } 102,893 | 893 


] County 2,983 3,393 
Department of 

Education 

wooo [ste | = Te ff [| [a 
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Portable Practical 2,125 7,235 
Educational 
Preparation Inc. 


eiPasoiso | Paso ISD | 2.102 | 102 | 61,762. | 762 


Battle Ground 1,971 13,654 
School District 


| 1951 951 | 91,363 | 363 


Corinth School = a 7 
District 

Hobbs Municipal NM 1,878 5 67 27 1 9,956 
Schools 

District of Columbia |DC 1,857 91 1 11 48,775 
Public Schools 

San Diego County 1,718 1,918 
Office of Education 

Berrien Springs a 651 ee 107 
Public Schools 


Antelope Valley 1,501 23,834 
Union High School 
District 
San Joaquin County =, 461 mas 752 
Office of Education 

iZ 7 eC = — 
Division of Youth a 444 Lo 444 
Service 
Fairfax Co Public al ad 
Schools 


a 7 TSP] — 
Milwaukee School WI 1,346 76 17 5 1 1 1 19 76,021 
District 
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Kern County Office |CA 
of Education 


Long Beach Unified |CA 


Los Angeles County |CA 
Office of Education 


CA 


Marshfield Unified WI 1,212 1 
School District 
T™ 1,207 37 


IN 
CA 


San Bernardino 
City Unified 


Birmingham Public 
Schools 


Texas Juvenile 
Justice Department 


Tri-Creek School 
Corporation 


Fresno Unified 
School District 
Redlands Unified CA 


Fullerton Joint 
Union High 


Edmonds School 
District 


Soledad 
Enrichment Action 
Charter High 


State Charter 
School Institute 


Zz 
< 


Clark County 
School District 


Visalia Unified 
Oakland Unified 


Mary Walker School 
District 


WA 


a) 
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Austin ISD 


— 
x< 


Wyoming Public 
Schools 


Department of 
Juvenile Justice 


Gwinnett County GA 
Kent School District 
Portland SD 1J 

Brownsville ISD 


Corona-Norco 
Unified 


Volusia 


Oak Park School MI 
District 
Elk Grove United 


Whittier Union High |CA 


Oxnard Union High 


Davidson County 


East Side Union 
High School District 


Spokane School 
District 


Alachua 


School District No. 
R-1 


Dekalb County 


Oklahoma City 


Anchorage School AK 
District 


Page 50 GAO-19-373 


Agency 
Haldgeye[O(edteya Background Major Findings Comments and 
Our Evaluation 


Congressional 


Addressees Appendixes Contacts 


Insight School of 
Michigan 


> 


Newton County 


o 


Morgan County 


Lakeside Union 
Elementary 


Osceola 


Zz 


New York City 
Public Schools 


M 
> 


San Bernardino 
County Office of 
Education 


Granite District 


Desert Sands 
Unified 


(@) 
> 


Caddo Parish 


Madison District 
Public Schools 


Baltimore City 
Public Schools 


Fontana Unified 


Manatee 


rc 


Collier 


San Antonio ISD 


Dallas ISD 


rc 


Okaloosa 


Richland School 
District 


Omaha Public 
Schools 


Antioch Unified 


Page 51 GAO-19-373 


Agency 
Haldgeye[O(edteya Background Major Findings (Coan laat-alecwelare! 
Our Evaluation 


Congressional 


Addressees Appendixes Contacts 


Rochester Public MN 
School District 


Eldon R-I 
Southgate AZ 
Academy Inc. 


Legend: AI/AN = American Indian/Alaska Native. 
Source: GAO analysis of data from the Department of Education's Civil Rights Data Collection for school year 2015-16| GAO-19-373 
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Appendix III: Comments from the Department of Education 


UNITED STATES DEPARTMENT OF EDUCATION 


OFFICE FOR CIVIL RIGHTS 
THE ASSISTANT SECRETARY 


May 10, 2019 


Ms. Jacqueline Nowicki, Director 
Education, Workforce, 

and Income Security Issues 
Government Accountability Office 
Washington, DC 20548 


Dear Ms. Nowicki: 


Thank you for the opportunity to provide comments on the Government Accountability Office 
(GAO) draft report, K-12 Education: Certain Groups of Students Attend Alternative Schools in 
Greater Proportions than They Do Other Schools (GAO-19-373). I am providing comments on 
behalf of the U.S. Department of Education (Department) regarding some of the methodological 
limitations of the GAO draft report and its conclusions. Many of these comments have been 
prepared by the Institute of Education Sciences. 


The Department appreciates the importance of GAO looking at the enrollment of students in 
public K-12 alternative schools. As the draft report notes, alternative schools serve some of our 


nation’s most vulnerable students, and it is important to ensure students at these schools receive 
the services they need in order to successfully participate in their education. As discussed below, 
we recommend that GAO, in the summary and in the body of the report, explicitly highlight the 
report’s limitations and caution readers regarding the implications of these limitations. We have 
enclosed the Department’s technical comments highlighting these problems, which we hope will 
help GAO improve the report. 


Here, let me first note that the definition of alternative schools and alternative learning 
environments (ALE) vary widely across the states. We encourage GAO to carefully review and 
consider this variability as it raises issues with the report’s methodology and conclusions. It is 
also important to note that part of the analysis included in the draft report is based on data 
reported for seven out of nearly 15,000 school districts. 


More important are the methodological limitations of the report. The predictive effects of the 
variables included in this report, i.e., race, ethnicity, and disability, are most likely dwarfed (and 
certainly confounded) by the effects of other variables, such as socio-economic status, exposure 
to violence and trauma, and family and neighborhood effects. The GAO report recognizes that 
multiple factors affect the likelihood of a student being assigned to ALE, but its analyses are 
overwhelmingly single variable comparisons. But because these factors (e.g., exposure to 
trauma, poverty, and race/ethnicity) are highly correlated, looking at any one factor without 
considering the effects of other correlated factors will likely lead to erroneous results. 


400 MARYLAND AVE. S.W., WASHINGTON, DC 20202-1100 
www.ed.gov 


The Department of Education's mission is to promote student achievement and preparation for global competitiveness 
by fostering educational excellence and ensuring equal access. 
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For instance, the GAO draft report analyzes disproportionality by comparing the proportion of 
students by race/ethnicity in ALE with the proportions of students in non-alternative learning 
environments. In this analysis, essentially differences in the racial/ethnic composition of students 
between ALE and non-ALE are assigned to racial/ethnic factors, setting aside all other 
contributors to that pattern of enrollments. This results in estimates of racial/ethnic driven 
disproportionality that are upwardly biased for Black and Hispanic students. The same bias exists 
because of the high correlation between the types of trauma described in the report and the 
race/ethnicity of the students. 


Because GAO presents analyses that attribute all the disproportionality to race/ethnicity 
regardless of other factors, the draft report does not provide a clear picture of how much of the 
disproportionality is caused by race/ethnicity and how much is simply correlated with it. The 
entanglement of correlation and causation reduces the value of the report for understanding the 
policy implications of the findings 


Consequently, we are concerned that less sophisticated readers will attribute the differences in 
enrollment to race and disability rather than some of the other factors that clearly contribute to 
enrollment patterns. More explicit cautionary language is needed to reduce such 
misunderstanding on the part of your readership. 


The Department appreciates the opportunity to provide these comments as well as the enclosed 
technical comments on the GAO draft report. We are available to respond to any questions or 
have further discussions if that would be helpful. 


Sincerely, 


Kae 


Kimberly Richey 
Principal Deputy Assis 
for Civil Rights 


Enclosure 
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GAO Contact Jacqueline M. Nowicki, (617) 788-0580, nowickij@gao.gov 
Staff In addition to the contact name above, Sherri Doughty (Assistant 
Acknowledgments Director), Cady S. Panetta (Analyst-in-Charge), Eve Weisberg, Holly Dye, 


Brian Egger, John Mingus, and James Rebbe made key contributions 
to this report. Also contributing were James Bennett, Deborah Bland, 
David Blanding, Kelsey Kreider, Sheila R. McCoy, Austin Sprinkles, and 
Daren Sweeney. 
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(102775) 


Report Director(s) 

Jacqueline M. Nowicki 

Director, Education, Workforce, and Income Security Issues, (617) 788-0580, 
nowickij@gao.gov 


Congressional Relations 
Orice Williams Brown, Managing Director, williamso@gao.gov, (202) 512-4400 


Public Affairs 
Chuck Young, Managing Director, youngc1 @gao.gov, (202) 512-4800 


Strategic Planning and External Liaison 
James-Christian Blockwood, Managing Director, spel@gao.gov, (202) 
512-4707 


Obtaining Copies of GAO Reports and Testimony 

The fastest and easiest way to obtain copies of GAO documents at no cost 
is through our website. Each weekday afternoon, GAO posts on its website 
newly released reports, testimony, and correspondence on our website. You 
can also subscribe to GAO's e-mail updates to receive notification of newly 
posted products. 


Order by Phone 
The price of each GAO publication reflects GAO's cost of production and 
distribution. Pricing and ordering information is posted on our website. 


To Report Fraud, Waste, and Abuse in Federal Programs 
Website: http://www.gao.gov/fraudnet/fraudnet.htm 
Automated answering system: (800) 424-5454 or (202) 512-7470 


Connect with GAO 
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GAO on our website and read the Watchblog. 
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